EQUATIONS, INEQUATIONS AND INEQUALITIES 
CHARACTERIZING THE CONFIGURATIONS OF TWO 
REAL PROJECTIVE CONICS 

EMMANUEL BRIAND 

Abstract. Couples of proper, non-empty real projective conies 
can be classified modulo rigid isotopy and ambient isotopy. We 
characterize the classes by equations, inequations and inequalities 
in the coefficients of the quadratic forms defining the conies. The 
results are well-adapted to the study of the relative position of two 
conies defined by equations depending on parameters. 
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1. Introduction 

Couples of proper real projective conies, admitting real points, can be 
classified modulo ambient isotopy. The goal of this paper is to provide 
equations, inequations and inequalities characterizing each class. 

This is particularly well-suited for the following problem: given two 
conies whose equations depend on parameters, for which values of the 
parameters are these conies in a given ambient isotopy class ? 

Such problems are of interest in geometric modeling. They are con- 
sidered for instance in the articles [HI EOj (and [21] for the similar prob- 
lem for ellipsoids). We consider this paper as the systematization of 
their main ideas. Specially, in 0, an algorithm was proposed to de- 
termine the configuration of a pair of ellipses, by means of calculations 
of Sturm-Habicht sequences. Our approach is different: when there, 
computations were performed for each particular case, we perform the 
computations once for all in the most general case. The formulas ob- 
tained behave well under specialization. 

Instead of working with ambient isotopy, we consider another equiv- 
alence relation, rigid isotopy 1 , corresponding to real deformation of the 
equations of the conies that doesn't change the nature of the (complex) 
singularities (definition [TJ following the ideas of [12] )• Figures [T] and 
12 provide a drawing for a representative of each class. Rigid isotopy 
happens to be an equivalence relation just slightly finer than ambient 
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Figure 1. The rigid isotopy classes for generic pairs of conies. 
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IVN VN(*) 



Figure 2. The rigid isotopy classes for non-generic pairs 
of proper conies. 

isotopy. So we get the classification under ambient isotopy directly 
from the one under rigid isotopy. 

The classification of pairs of real projective conies under rigid isotopy 
was first obtained by Gudkov and Polotovskiy E2] in their work 

on quartic real projective curves. Nevertheless, we start (section 2) 
with re-establishing this classification. We emphasize the following 
key ingredient: that any rigid isotopy decomposes into a path in one 
orbit of the space of pencils of conies under projective transformations, 
and a rigid isotopy stabilizing some pencil of conic (Lemma EJ). As 
a consequence, each rigid isotopy class is determined by an orbit of 
pencils of conies and the position of the two conies with respect to 
the degenerate conies in the pencil they generate. This has two direct 
applications. 
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First, because there are finitely many orbits of pencils of conies under 
projective transformations, we get easily a finite set of couples of conies 
meeting at least once each rigid isotopy class. 

Second, it indicates clearly how to derive the equations, inequations, 
inequalities characterizing the classes, which is done in section 3. The 
determination of the position of the conies with respect to the degen- 
erate conies in a pencil essentially reduces to problems of location of 
roots of univariate polynomials. They can be treated using standard 
tools from real algebra, namely Descartes' law of signs and subresultant 
sequences. This contributes both to the characterization of the orbits 
of pencils of conies, and the characterization of the rigid isotopy class 
associated to each orbit of pencils of conies. Classical invariant theory 
is also used for the first task. 

Last, section 4 provides some examples of computations using the 
previous results. 

Generalities and notations. The real projective space of dimension 
k will be denoted with WP k ; in particular, RP 2 denotes the projective 
plane. The space of real ternary quadratic forms will be denoted with 
S^R 3 *. We will consider P(,S 2 R 3 *), the associated projective space (see 
[Hj for the definitions of the notions of projective geometry needed here). 
The term conic will be used with two meanings: 

• an algebraic meaning: an element of P(S 2 R 3 *). The algebraic 
conic associated to the quadratic form / will be denoted with 

[/]■ 

• a geometric meaning;: the zero locus, in RP 2 , of a non-zero 
quadratic form /. It will be denoted with [/ = 0]. 

A (geometric or algebraic) conic is said proper if it comes from a non- 
degenerate quadratic form; degenerate if it comes from a degenerate 
quadratic form. Note that, with this definition, the empty set is a 
proper (geometric) conic. Algebraic and geometric proper non-empty 
conies are in bijection, and can be identified. 

We define the discriminant of the quadratic form f to be 

Disc(/) = det(Matrix(/)). 

Any proper non-empty conic cuts out the real projective plane into 
two connected components. They are topologically non-equivalent: one 
is homeomorphic to a Mobius strip, the other to an open disk. The 
former is the outside of the conic, the latter is its inside. Let / = 
x 2 + y 2 — z 2 . The inside of [fo = 0] is the solution set of the inequation 
fo < 0, or, equivalently, the set of points where fo has the sign of 
Disc(/o). These signs change together under linear transformations. 
Now any proper, non-empty conic is obtained from [fo = 0] by means 
of a transformation of PGL(3,M). Thus the inside of [f = 0] is the set 
of points where f takes the sign o/Disc(/). 
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The tangential quadratic form associated to the quadratic form / 
on R 3 is the quadratic form / on IR 3 * whose matrix is the matrix of 
the cofactors of the matrix of /. The tangential conic associated to [/] 
(resp. / 0) is [/] (resp. / 0]). 

A pencil of quadratic forms is a plane (through the origin) in S^M 3 *; 
the associated (projective) pencil of conies is the corresponding line in 
P(S' 2 1R 3 *). It is said to be non- degenerate if it contains proper conies 2 . 
The common points of all conies of a given pencil are called the base 
points of the pencil. They are also the common points of any two dis- 
tinct conies of the pencil. A non-degenerate pencil of conies has always 
four common points in the complex projective space, when counted 
with multiplicities. 

Note that we will distinguish between (ordered) couples of conies 
((Ci, C2) distinct from (C 2 , Ci), except when C\ = C 2 ) and (unordered) 
pairs of conies ({C\, C 2 } = {C 2 , Ci}). 

The characteristic form of the couple (/, g) of real ternary quadratic 
forms is the binary cubic in (t,u): 

<S>(f,g;t,u) := Disc(tf + ug). 

Its coefficients will be denoted as follows: 

$(/, g; t, u) = $ 30 t 3 + <$> 2 it 2 u + $ 12 tu 2 + $ 30 m 3 . 

We will also consider the de-homogenized polynomial obtained from $ 
by setting u — 1. It will be denoted with (f)(f,g;t), or <p(t) when there 
is no ambiguity about /, g. So: 

4>{t) :=Disc(*/ + <?) 

Note that $ 30 = Disc(/) and $ 03 = Disc(#). 

An isotopy of a manifold M is a continuous mapping : I x M — > 
M, where / is an interval containing 0, such that for each t G I, 
the mapping x 1— > 0(t,x) is an homeomorphism of M onto itself, and 
x 1— > ^(0, x) is the identity of M. 

Two subsets Ni, N 2 of M are ambient isotopic if there is an isotopy 
of M such that, at some instant t e 7, ^(t, iVi) = A^. 

This definition is immediately generalized to couples of subsets: (JVi, ATQ 
and (A^ 2 , A^) are ambient isotopic if there is an isotopy of M such that, 
at some instant t, 0{t, Ni) = N 2 and 0(t, JV() = A^. 

2. Classification 

2.1. Rigid isotopy. To classify the couples of conies up to ambient 
isotopy, we introduce a slightly finer equivalence relation, rigid isotopy, 
corresponding to a continuous path in the space of couples of distinct 
proper conies, that doesn't change the nature of the complex singular- 
ities of the union of the conies. Before stating formally the definition 

2 Contrary, for instance, to the pencil of the zero loci of the f(x, y, z) = Xxy+fixz. 
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(definition below), we clarify this point. The complex singularities of 
the union of the conies correspond to the (real and imaginary) intersec- 
tions of the conies. For a given multiplicity, there is only one analytic 
type of intersection point of two conies. Thus the nature of the sin- 
gularities for the union of two distinct proper conies is determined by 
the numbers of real and imaginary intersections of each multiplicity. 
This is narrowly connected to the projective classification of pencils of 
conies, that can be found in [3 El ■ The connection is the following 
theorem. 

Theorem 1. (pj E!) Two non-degenerate pencils of conies are equiv- 
alent modulo PGL(3,M) if and only if they have the same numbers of 
real and imaginary base points of each multiplicity. 

The space of couples of distinct real conies is an algebraic fiber bundle 
over the variety of pencils, which is a grassmannian of the MP^s in a 
MP 5 . The fibers are isomorphic to the space of couples of distinct points 
in MP 1 . The sets of couples of distinct conies with given numbers of real 
and imaginary intersections of each multiplicity are, after Theorem ^ 
exactly the inverse images of the orbits of the variety of pencils under 
PGL(M?), and are thus also smooth real algebraic submanifolds. 

We can now state the following definition. 

Definition 1. Two couples of distinct proper conies are rigidly isotopic 
if they are connected by a path in the space of couples of distinct proper 
conies, along which the numbers of real and imaginary intersections of 
each multiplicity don't change. 

We will now show that rigidly isotopic implies ambient isotopic. We 
first show it for some special rigid isotopies. 

Definition 2. Let f,g be two non- degenerate non-proportional qua- 
dratic forms. We define a sliding for [/] and [g] as a path of the form 
t i — ► ([/ + tkg), [g]) (or t i— » ([/], [g + tkf)) ) for t in a closed interval 
containing 0; no t with f + tkg (resp. g + tkf) degenerate; and k some 
real number. 

Let a be an homeomorphism of MP 2 . For a couple ([/], [g]) of non- 
empty proper conies, we write [g\) for the couple of algebraic 
conies corresponding to (a([f = 0]),a(\g = 0])). 

Lemma 1. Any sliding, for a couple of non-empty conies, lifts to an 
ambient isotopy. 

For a sliding: 

t^([f + tkg},[g}), tel 

with [/ = 0] and [g = 0] non-empty, this means that there exists a 
family of homeomorphisms (3 t of MP 2 , with (3 = id and /?*([/], [g]) = 
([f + tkg],[g]). 
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Proof. Let B be the set of the base points of the pencil of [/] and [g\. 
A stratification of RP 2 x I is given by: 

5 1 = BxI 

5 2 = ([g = 0]xI)\S 1 

5 3 = {(p;t)\(f + tkg)(p) = 0}\S l 

5 4 = (MP 2 x J) \ (Si US 2 U S 3 ) 

One checks this stratification is Whitney. The projection from MP 2 x / 
to I is a proper stratified submersion. The lemma now follows, by direct 
application of Thorn's isotopy lemma, as it is stated in [H]. □ □ 

Lemma 2. Consider two couples of distinct proper non-empty conies. 
If they are rigidly isotopic, then they can also be connected by a rigid 
isotopy a t (s t ) where 

• St is a sequence of slidings along one given pencil. 

• at is a path in PGL(3,M.) with «o = id 

Proof. Let (Co, Do) an d (Ci,£>i) be the couples of conies, and t i— > 
(Ct,D t ), t G [0; 1] be the rigid isotopy that connects them. It projects 
to a path in one PGL (3, K)-orbit of the variety of pencils. This path 
lifts to a path a t of PGL(3,M) with cto = id (indeed, the group is a 
principal fiber bundle over each orbit; specially, it is a locally trivial 
fiber bundle: ch. I, 4). 

The mapping t h- > atj~ 1 (Ct,D t ) is a rigid isotopy drawn inside one 
pencil of conies. Such an isotopy is easy to describe: the pencil is a 
space MP 1 with a finite set T of degenerate conies. Let E = MP 1 \ T. A 
rigid isotopy inside the pencil is exactly a path in E x E \ Diag(i? x E). 
There exists a finite sequence s t of horizontal and vertical paths, i. e. 
of slidings, having also origin (C ,-D ) and extremity a ] ^ 1 (Ci,D 1 ). 

Consider now a t (s t ). This is a rigid isotopy connecting (C ,D ) to 
(C 1 ,D 1 ). □ □ 

Theorem 2. Two couples of distinct proper non-empty conies that are 
rigidly isotopic are also ambient isotopic. 

Proof. Let (Co, A)) and (Ci,Di) be rigidly isotopic. Consider a path 
t G [0, 1] i— > a t (st) connecting them, as in LemmaEl After Lemma^ St 
lifts to an ambient isotopy fit with (3q = id. Then at o f3 t is an ambient 
isotopy carrying (Co, A)) to (Ci,Di). □ □ 

2.2. Orbits of pencils of conies. After there are nine orbits 

of non-degenerate pencils of conies under the action of PGL(3, M). We 
follow Levy's nomenclature ^Zj for them. It is presented in the follow- 
ing table, where the second and third lines display the multiplicities of 
the real and imaginary base points. For instance, 211 stands for one 



THE CONFIGURATIONS OF TWO REAL PROJECTIVE CONICS 7 



Orbit 


/o 


9o 






'2 '2 


1 


x 2 — y 2 


ar — z z 


la 


x 2 + y 2 + z 2 


XZ 


lb 


x 2 + y 2 — z 2 


xz 


II 


yz 


x(y - z) 


Ma 


y 2 + z 2 


xz 


III 


xz 


y 2 


Ilia 


x 2 + y 2 


z 2 


IV 


xz — y 2 


xy 


V 


xz — y 2 


x 2 



Table 1. Levy's representatives for each orbit of pen- 
cils. Each representative is the pencil generated by [/ ] 
and [g ). 




Simple Double Triple 



Figure 3. Degenerate conies corresponding to multiple 
roots of the discriminant, in the representations of the 
pencils. 

base point of multiplicity 2 and two base points of multiplicity 1. 



Orbit 


1 


la 


lb 


II 


Ma 


III 


Ilia 


IV 


V 


real points 


1111 




11 


211 


2 


22 




31 


4 


imaginary points 




1111 


11 




11 




22 







We will also use the representatives of the orbits provided by Levy 
[T7] . Each representative is given by a pair of generators of the corre- 
sponding pencil of quadratic forms. They are presented in Tabled We 
provide, in figures El and EH graphical representations of characteristic 
features of the pencils in each orbit. This has two goals: finding how 
to discriminate between the different orbits of pencils, and determining 
the possible rigid isotopy classes corresponding to each orbit of pencils. 
Each pencil is displayed as a circle, as it is topologically. In addition, 
the following information is represented: 

• the degenerate conies of the pencil. They are given by roots of 
the characteristic form, so the multiplicity of this root is also 
indicated, following the encoding shown in Figure El 

• the nature of the proper conies (empty or non-empty) and of 
the degenerate conies (pair of lines, line or isolated point). The 
nature of the proper conies is constant on each arc between two 
degenerate conies. 
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non-empty proper 



empty 



two lines 



(double) line isolated point 



Figure 4. Nature of the conies, in the representations 
of the pencils. 




II Ma 

Figure 5. Pencils of conies up to projective equivalence (beginning). 

• In the case where the conies of one arc are nested, we indicate, 
by means of an arrow, which are the inner ones. 
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IV V 



Figure 6. Pencils of conies up to projective equivalence (end). 

These features are conserved under projective equivalence. Thus the 
representations are established by considering Levy's representative. 

2.3. Rigid isotopy classification for pairs. We first classify pairs 
of proper conies, that is: couples of distinct proper conies, under rigid 
isotopy and permutation of the two conies. Later, for each pair class, 
we will check whether it is also a couple class (that is: the exchange 
of the two conies corresponds to a rigid isotopy) or it splits into two 
couple classes. 

Any pencil of conies is cut into arcs by its degenerate conies. Two 
proper conies are either on a same arc, or on distinct arcs on the pencil 
they generate. 

Lemma 3. If a pencil of conies has (at least) two arcs of non-empty 
conies, then there are two equivalence classes for pairs of conies gen- 
erating it. They correspond to the following situations: 

• the conies are on a same arc. 

• the conies are on distinct arcs. 

If the pencil has only one arc with proper non-empty conies, there is 
only one class. 

Proof. The orbit of pencils is assumed to be fixed. Because of Lemma 
HJ to get (at least) one representative for each class, it is enough: 
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• to choose arbitrarily one conic on each arc and consider all the 
possible pairs of these conies. 

• to choose arbitrarily two conies on each arc and consider these 
pairs for each arc. 

But one observes that for a pencil in one of the orbits la, II, Ma, III, 
there is a projective automorphism that leaves it globally invariant and 
exchanges its two arcs (the two arcs bearing non-empty conies for orbit 
la). Again, this is proved by considering only Levy's representatives: 
the reflection x <-» —x is suitable. Similarly, a pencil in orbit I is 
left globally invariant by some projective automorphism that permutes 
cyclically the three arcs. For Levy's representative, one can take the 
cyclic permutation of coordinates: x i— > y \— > z i— > x. 

Pencils in the four other orbits have only one arc with non-empty 
proper conies. 

We have shown it is enough: 

• to choose arbitrarily one arc with non-empty conies and two 
conies on this arc. 

• to choose arbitrarily two arcs and one conic on each arc. 

This gives nine representatives for the pairs of conies on a same arc, 
denoted with IN, . . . , VN (N like neighbors) and five representatives for 
pairs of conies on distinct arcs, denoted with IS, laS, IIS, HaS, IMS (S 
like separated). 

Now it remains to check that for orbits I, la, II Ma and III, the S- 
representative and the N-representative are not equivalent. We use 
that a rigid isotopy conserves the topological type of (RP 2 , [/ = 0], [g — 
0]), after Theorem |2 To distinguish between IN and IS, one can count 
the number of connected components of the complement of [/ = 0] U 
[g = 0]: there are 6 in the first case and 5 in the second, the topological 
types are different, so are the rigid isotopy classes. For the other four 
orbits of pencils, one conic lies in the inside of the other (at least at 
the neighborhood of the double point for II) for the N-representative, 
while there is no such inclusion for the S-representative. □ □ 

Corollary 1. There are 14 equivalence classes for pairs of proper non- 
empty conies under rigid isotopy and exchange. Representatives for 
them are given in Tabled They correspond to the graphical represen- 
tations displayed in FiguresUl and\^ 

2.4. Rigid isotopy classification for couples. We now derive from 
our classification for pairs of conies the classification for couples of 
conies. 

Lemma 4. For each of the following representatives: IN, IS, laS, IbN, 
IIS, HaS, HIS, IVN, there is a rigid isotopy that swaps the two conies. 
As a consequence, each of these classes for pairs is also a class for 
couples. 
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class 


/ 


g 


IN 


3x 2 - 2y 2 - z 2 


3x 2 - y 2 - 2z 2 


IS 


3x 2 - 2y 2 - z 2 


x 2 - 2y 2 + z 2 


laN(*) 


x 2 + y 2 + z 2 + 3xz 


x 2 + y 2 + z 2 + 4xz 


laS 


x 2 + y 2 + z 2 + 3xz 


x 2 + y 2 + z 2 — 3xz 


IbN 


x 2 + y 2 — z 2 + xz 


x 2 + y 2 — z 2 — xz 


IIN(*) 


yz + xy — xz 


yz + 2xy — 2xz 


IIS 


yz + xy — xz 


yz — xy + xz 


MaN(*) 


y 2 + z 2 + xz 


y 2 + z 2 + 2xz 


llaS 


y 2 + z 2 + xz 


y 2 + z 2 — xz 


IIIN(*) 


XZ+ 2 


xz + 2y 2 


IMS 


xz + y 2 


X2 — y 2 


MlaN(*) 


x 2 + y 2 — z 2 


x 2 + y 2 - 2z 2 


IVN 


xz — y 2 + xy 


xz — y 2 — 2xy 


VN(*) 


i i 
xz — y — x 


xz — y 2 + x 2 



Table 2. The rigid isotopy classes. 



Proof. For IN, IS, laS, IIS, llaS, IMS, it is enough to exhibit projective 
automorphisms that stabilize the corresponding Levy's representative 
and swap two arcs of non-empty proper conies. It was already done in 
the proof of Lemma El except for IN and IS. For them, the reflection 
y ^ z is convenient. 

For IbN and IVN, it is enough to exhibit projective automorphisms 
that stabilize the corresponding Levy's representative and reverse the 
pencil's orientation. For IbN, the reflection x i— > — x is convenient; for 
IVN, one may use the transformation x i— > —x, z i— > —z. □ □ 

Lemma 5. 

• Each of the classes of pairs laN, llaN, 1 1 IN, lllaN, VN splits into 
two classes for couples, corresponding to one conic lying inside 
the other (except for the base points). 

• The class of pairs UN also splits into two classes for couples, 
corresponding to one conic lying inside the other in a neighbor- 
hood of the double point (except the double point itself). 

Proof. The property that one conic lies inside the second is conserved 
under ambient homeomorphism, and thus under rigid isotopy. The 
same holds for inclusion at the neighborhood of a double intersection 
point. 

Thus it is enough to consider the representatives of the given pair 
classes and check the inclusion to show the theorem. The computations 
are trivial, hence we omit them. □ □ 

Theorem 3. There are 20 classes of couples under rigid isotopy. A 
set of representatives is given by Tabled where the reader should add 
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the couple obtained by swapping f and g for each of the lines marked 
with (*). 

Corollary 2. The ambient isotopy classes for couples of conies are the 
following unions of rigid isotopy classes: 

• classes where the two conies can be swapped: IN, IS, laS, IbNU 
IVN, IIS, llaS and IIIS. 

• pair classes splitting into two classes for couples, one with [f = 
0] inside [g = 0], one with [g = 0] inside [f = 0]: /aA/U lllaN, 
UN, //aA/U VN and 1 1 IN. 

Proof, (sketch) One shows that IbN and IVN are ambient isotopic by 
building explicitly a homeomorphism 3 of MP 2 sending a representative 
of the first to a representative of the second. Details on how to do it 
are tedious, we skip them. Idem (with [/ = 0] inside [g = 0]) for laN 
and lllaN, and for MaN and VN. 

Next, one shows the displayed rigid isotopy classes or unions of rigid 
isotopy classes are not equivalent modulo ambient isotopy. This is done 
by considering topological invariants of the triples (MP 2 , [/ = 0], [g — 
0]) which take different values on the 15 representatives. 

Let C be the conic [/ = 0] (resp. D the conic [g — 0]), I (resp. J) 
its inside and I (resp. J) the topological closure of this inside. 

Then one checks that the numbers of connected components of the 
four following sets are suitable for separating the ambient isotopy classes: 

CnD, MP 2 \ (CUD), I\J, J\I 

□ □ 

Remark : It is legitimate curiosity to compare these isotopy classes of 
couples of conies with the isotopy classes of projective quartic curves 
presented in [H^, the union of two conies being a quartic. One then 
observes that IN corresponds to 17p, IS to 16p, laS to 22p, IIS to 34p, 
llaS to Up, IIIS to 38p, laN U lllaN to 21p, 1 1 INI to 36p and MaN U VN to 
A3p. Finally both IbN U IVN and INN correspond to ISp. B 

3. Characterizing the isotopy classes by equations, 
inequations and inequalities 

3.1. Preliminaries. 

3.1.1. The invariants and covariants of two ternary quadratic forms. 
Invariants and covariants (see ^H] for a modern reference about clas- 
sical invariant theory) are the convenient objects to discriminate, by 
means of equations and inequalities, between the different orbits for 
couples of complex conies under the group PGL(3, C). 

3 This is enough. Indeed, the set of the homeomorphisms of MP 2 is connected, so 
any homeomorphism is the extremity of some ambient isotopy. 
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Invariants and covariants of a couple of quadratic ternary forms have 
been calculated by the classics, and can be found in Glenn's book [TU] 
or Casey's treatise j^J- 

Proposition 1. The algebra of invariants of a couple of ternary qua- 
dratic forms is freely generated by the coefficients of the characteristic 
form . 

The invariants alone are not sufficient to discriminate between the 
complex orbits. One has to consider the covariants. Some remarkable 
covariants of a couple of ternary quadratic forms are: 

• The apolar covariant of the tangential quadratic forms f and 
g. We will denote it with F. This is a quadratic form that 
depends quadratically on /, as on g. 

• The autopolar triangle covariant G, a cubic form that is also 
cubic in /, as in g, and that always factorizes as a product of 
three linear forms. When [/ = 0] and [g = 0] have four distinct 
intersections, they are equations of the sides of the unique au- 
topolar triangle associated to them (see |2J, 14.5.4 and 16.4.10). 

Proposition 2. The algebra of covariants of a couple of ternary qua- 
dratic forms (f, g) is generated by the invariants, the ground forms f 
and g, the apolar covariant F and the autopolar triangle covariant G. 

The covariant F will not be needed in this paper, but G will be used. 
We now explain how to derive a formula for it. Consider a generic 
couple of forms f,g. Let ti,t2,t 3 be the three roots of Disc(£/ + g). 
Each of the Uf+g has rank two. Their respective associated tangential 
quadratic forms have all rank one: they are the squares of three linear 
forms pi, P21VZ °f the dual space, and the associated points \pi], [p 2 ], [P3] 
of P(M 3 ) are exactly the vertices of the autopolar triangle. The sides of 
the triangle are obtained as the zero loci of the product of determinants: 

det (pi , p 2 , p) det (p x , p 3 , p) det (p 2 , p 3 , p) ■ 

Working in coordinates, with p { = pnX + p i2 Y + Pi 3 Z, where X, Y, Z 
are coordinates on R 3 * dual to x, y, z, one expands this and replace the 
products PijPik by the corresponding term given by the equality 

Pi = 

This product is antisymmetric in ti,t 2 ,^3, and thus can be divided by 
the Vandermonde determinant [t\ — t 2 )(ti — ^3)^2 — £3)- The quotient 
happens to be free of t^s: it is, up to a rational number in factor, the 
covariant G. 



The analogue assertion is still true for a couple of quadratic forms in n variables, 
for any n. 
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One finds that the formula for this covariant can be displayed shortly. 
Denote: 

tpTg = ft 2 + n(f,g)t+~g 

and 

/ = "HkXWz", Q(f, g) = J2 UijkX'YiZ", g = J2 h 3 kX l Y J Z k 
Consider the matrix of their coefficients: 



M 



a 200 a 020 a 002 a 011 a 101 a llO 
^200 ^020 ^002 ^011 k'lOl ^110 
&200 ^020 &002 bon feioi &110 



and label its columns with 1,2,3,1,2,3. Label the maximal minor 
corresponding to columns k with [ijk]. Then the autopolar triangle 
covariant is, up to a rational number in factor, 

-[12 3]x 3 -[12 3]y 3 - [1 2 3]z 3 + ([1 1 3] + 2[3 2 3})xy 2 
+ ([121] +2[22 3])xz 2 + ([2 2 3] + 2[13 3])ys 2 + ([1 2 2] + 2[1 1 3])yz 2 
+ ([3 2 3] + 2[1 2 2})zx 2 + ([1 3 3] + 2[1 2 l])zy 2 + ([1 2 3] + 4[1 2 3])xyz. 

3.1.2. Resultants. Let U(t) and V(t) be two univariate polynomials. 
Remember that their resultant Res(£7, V) is the determinant of their 
Sylvester matrix: the matrix of the coefficients of degree deg(£7) + 
deg(V) — 1 down to of 

A few classical formulas about resultants will be needed. 
Lemma 6. One has 

Res(U,V) = {-l) deeiu)dee(v) Res{V,U). 
Lemma 7. Let c be the leading coefficient of U . Then 

Res(tf, V) = c deg(y) \\ V(p) 

where the product is carried over the complex roots p of U , counted with 
multiplicities 5 . 

Lemma 8. Let U(t), V(t), W(t) be three univariate polynomials. Then 
Res(U, VW) = Res(U, V) Res(U, W). 

And last: 

Lemma 9. Let U(t),V(t) be two univariate polynomials, and W the 
remainder in the euclidean division of U by V . Let c be the leading 
coefficient of V. Then 

Res(U,V) = (_l)deg(t/)deg(y) c deg(C7)-deg(Ty) Res ^ ?W ,)_ 

This is Lemma 4.27 in pQ, where a proof is provided. 
5 e.-g. a double real root should be here counted as two roots. 
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3.1.3. Descartes' law of signs. Let U(t) be an univariate polynomial. 
Then Descartes' law of signs give some insight about its number M(U) 
of positive real roots, counted with multiplicities. 

Consider the sequence of the signs (+'s and — 's) of the (non-zero) 
coefficients of U and denote with V(U) the number of changes in con- 
secutive terms. The following lemma is Descartes' Law of signs. It can 
be found as Theorem 2.34 in IT]. 



Lemma 10. One has V(U) > N{U), and V(U) - M(U) 



is even. 



Only the following particular consequence will be needed in the se- 
quel: 

Lemma 11. Let U(t) = u 3 t 3 + u 2 t 2 + U\t + Uq of degree 3. Suppose U 
has all its roots real and non-zero. Then they have all the same sign if 
and only if: u 3 Ui > and u 2 Uo > 0. 

It is obtained by applying Descartes' law of signs to U(t) and U(—t). 

3.1.4. Subresultant sequences. Here we briefly introduce another tool: 
subresultant sequences. More details about them can be found in the 
book p. 

Let U(t),V(t) be two univariate polynomials. One wants to know 
on how many 6 of the (real) roots of V the polynomial U is positive, 
negative, and zero. The Sturm query of U for V is defined as the 
number of roots of V making U > 0, minus the number of roots of V 
making U < 0. This information is easily accessible once one knows 
the signs of the deg(V) + 1 signed subresultants principal coefficients of 
V and W, where W is the remainder in the euclidean division of U ■ V 
byV. 

We give the formulas for these signed subresultant principal coeffi- 
cients, and the procedure for getting the Sturm query from their signs, 
only for the particular case needed: when V has degree 3. Write 

v 3 t 3 + v 2 t 2 + Vit + v 

W 2 t 2 + Wit + Wq. 



V 

w 



Then 



sr 3 (V,W)=v 3 , 



sr 2 (V, W) = w 2 , 









V3 


v 2 




vo 







^3 


t'2 


Vl 







v 3 


v 2 


Vl 


^0 


sn(V, W) = 





w 2 


Wi 


, ST (V,W) = 








w 2 


Wi 


w 




w 2 




w 







<-< ! 2 


Wi 


Wo 











w 2 


Wi 


w 









6 When dealing with subresultant sequences, the multiplicities of the roots are 
not taken into account, e.-q. a double root will be counted as one root. 
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Note that sr (V, W) = — Res(V, W), the opposite of the resultant of V 
and W. The Sturm query is obtained from the sequence of the signs 
of sr 3 , sr 2 , sri, sr the following way 7 : 

(1) If there is a pair of consecutive zeros, remove it and change the 
signs that were following to their opposites. 

(2) From the resulting sequences of consecutive non-zero terms, 
compute the difference: number of sign permanences (identical 

consecutive terms, ++ or ) minus number of sign exchanges 

(opposite consecutive terms, H — or — h). This gives the Sturm 
query 8 . 

3.2. Discriminating between the orbits of pencils. In this sec- 
tion, we give the equations and inequations characterizing the couples 
(/, g) of non-degenerate quadratic forms generating a pencil of each of 
the orbits. 

We first use invariants and covariants whose vanishing depends only 
of the generated pencil, that is those C that, besides the good behavior 
with respect to the action of SL(3, C): 



C(f o6,go9;x, y, z; t, u) = C(f, g; 9(x, y, z); t, u) V0 G SL(3, C) 



C(9(f, g);x, y, z; 8(t, it)) = C(f, g; x, y, z; t, u) W9 e SL(2, C). 



Such objects are called combinants. 

Obviously, the characteristic form $ and its covariants are combi- 
nants. Remember that the algebra of the covariants of a binary cubic 
form $(£,«) is generated by the ground form $, its discriminant 9 , and 
its Hessian determinant, which are 



(the division is a simplification in the definition of the discriminant, 
that is: there remains no $30 at the denominator). The covariant G is 
also a combinant. 

The vanishing or non-vanishing of each of the combinants are prop- 
erties of the orbits of pencils of conies. The sign of Disc($) is also 
invariant on each orbit of pencils of conies (because Disc($) has even 
degree in / as well as in g). Thus we just evaluate the combinants on 
Levy's representatives, and we get the following result: 

7 for this specific case with 4 terms in the sign sequence. 

8 So for instance, the sign sequence +0 — has no sign permanence, nor sign 
change (because there are no consecutive non-zero terms). For the sign sequence 
+00—, the Sturm query is computed as for H — (-: one permanence, no change, this 
gives 1. 

9 The discriminant of the characteristic form, Disc($), is called the Tact invariant 
by the classics, because it vanishes exactly when the two conies are tangent 0- 



are covariant with respect to combinations of / and g: 
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Proposition 3. Let f, g be two non-proportional non-degenerate ternary 
quadratic forms. 

• //Disc($) < then f,g generate a pencil in orbit I or la. 

• //Disc($) > then f,g generate a pencil in orbit lb. 

• //Disc(<l ) ) = then f, g generate a pencil in one of the six other 
orbits. The following table indicates how the vanishings of H 
and G discriminate further between the orbits of pencils ( under 
the hypothesis that the discriminant vanishes): 







H = 


Gj+0 


II, lla 


IV 


G = 


III, Ilia 


V 



Remark : The fact that the coefficients of G are linear combinations 
of maximal minors of the matrix M defined in 13.1.11 suggests that the 
vanishing of G is equivalent to: M takes rank two. This is true. To 
see this, consider the image of the (complex) pencil generated by [/] 
and [g] by the quadratic mapping "tangential quadratic form" from 
P(S" 2 C 3 *) to P(S' 2 C 3 ). It is an irreducible conic, thus either a proper 
conic or a line. One checks on Levy's representative that it is a line 
exactly when G = (see also 16.5.6.2). Finally, remark that the 
rows of M are the coordinates of generators of the linear span of this 
conic. □ 

It remains now to discriminate between I and la, between II and lla 
and between III and Ilia. For this we use that the numbers of degenerate 
conies of each type (pair of lines, isolated point or double line) in a 
pencil characterize its orbit, as shown in the table below, established 
by considering figures El and El 



orbit of pencils 


1 


la 


II 


lla 


III 


Ilia 


num. pairs of line 


3 


1 


2 


1 


1 





num. isolated points 





2 





1 





1 


num. (double) lines 














1 


1 



This has an algebraic translation. Consider 

det(v-/-Matrix(tf + #)) 

that expands into 

v 3 - fi(t)v 2 + if)(t)v - <p{t). 

A degenerate conic of the pencil corresponds to a parameter t that 
annihilates <fi, and is 

• a pair of lines when Matrix(t/ + g) has one eigenvalue positive, 
one negative, and one zero. Then ip(t) < 0. 

• an isolated point when the matrix has an eigenvalue zero and 
the two other both positive or both negative. Then ip(t) > 0. 
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• a single line when the matrix has two eigenvalues zero, and one 
non-zero. Then ip(t) = 0. 

Thus the discriminations can be performed by a Sturm query of if> for 
0. In order not to introduce denominators, we consider the euclidean 
division of ^soipcf)' by 0, instead of the division of -00' by suggested 
by EH Set 

P = Remainder($ 30 • ^ • (/)', 0) 
= p 2 t 2 + pit + p 

and 

M = sr;(0,P) 

for i between and 3. The consideration of the sign permanences 
and sign exchanges in $ 30 = A 3 ,A 2 ,Ai,A gives the Sturm query of 
$3O'0 for 0. The Sturm query of ip for is the same as the Sturm 
query of $§ o '0 for 0. Using that srj(0,$3 O P) = $ 30 ~ 1 sr;(0, P), we 
get that this Sturm query is obtained by considering the sign perma- 
nences and sign exchanges in $ 30 , & 30 A 2 , A±, $3oA); OT , simpler, those 
in 1, A 2 , 3> m Ai, A . 
The polynomial A\ is 



$30 


$21 


$12 





P2 


Pi 


P'2 


Pi 


Po 



And 

A = -Res(0,P). 
This simplifies. Applying Lemma El one gets 

Res($3o^0',0) = $3oRes(0,P). 
And, on the other hand, from Lemma |H] and the definition of Disc($): 
Res($3o^0', 0) = $30 • ResO, 0) ■ Disc($). 

Thus 

A = -$§ Res(^, 0) Disc($). 

3.2.1. Discriminating between I and la. Suppose / and g generate a 
pencil in orbit I or la. The Sturm query of ip for is —3 for orbit I and 
1 for orbit la. 

The assumption that /, g generate a pencil in orbit I or la gives more 
information: 

Lemma 12. If f,g generate a pencil in orbit I or la, then Aq < 0. 

Proof. We had established that A = — $3 Res(ip, 0) Disc($). For orbit 
I or la, one has Disc($) < 0. Moreover, Res(/0, 0) < because, from 
lemmas El and 

Res(^,0) = Res(0,VO = ^toH^(p), 
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where the product is carried over the three roots p of 0. They make 
either if) three times negative (orbit I), either one time negative and two 
times positive (orbit la). In both cases, the product is negative. □ □ 

There is only one sign sequence giving Sturm query —3 and beginning 

with + and finishing with — , that is H 1 — . There are several sign 

sequences giving Sturm query 1, beginning with +, finishing with — : 

+ + + - + + -- + + 0- + +0-- +00-. 

We deduce from this the criterion stated in the following proposition. 

Proposition 4. Let f, g be non- degenerate quadratic forms generating 
a pencil in orbit I or la. 

• if it is orbit I then P2 < and $30^1 > 0. 

• if it is orbit la, then P2 > 0, or $30^1 < 0, or P2 = A\ = 0. 

3.2.2. Discriminating between II and Ha. Suppose / and g generate a 
pencil in orbit II or Ha. Note first that Aq = 0. The Sturm query of if) 
for cf) is —2 for orbit II and for orbit Ma. 

There is only one sign sequence with beginning with +, finishing 

with that gives Sturm query —2, this is H h0. Those giving Sturm 

query are 

+ + -0 +--0 +0 + +0-0 +000. 

Proposition 5. Let f,g be non-degenerate quadratic forms generating 
a pencil in orbit II or Ha. 

• if it is in orbit II then p 2 < and $30^1 > 0. 

• if it is in orbit I la, then p 2 = or $30^1 < 0. 

3.2.3. Discriminating between III and Ilia. Suppose / and g generate a 
pencil in orbit III or Ilia. Once again, Aq = 0. The Sturm query of if) 
for is —1 for orbit III, 1 for orbit Ilia. 

The only sign sequence (beginning with +, terminating with 0) giving 
Sturm query —1 is H — 00. There is also only one giving Sturm query 
1, that is + + 00. 

Proposition 6. Let f, g be non-degenerate quadratic forms generating 
a pencil in orbit III or Ilia. 

• if it is in orbit III, then P2 < 0. 

• if it is in orbit Ilia, then P2 > 0. 

3.3. Characterizing the rigid isotopy classes for pairs inside 
each pencil. Given /, g two non-proportional non-degenerate qua- 
dratic forms, we suppose we know the orbit of the pencil they generate. 
After Lemma El one decides to which class belongs { [/] , [g] } by look- 
ing whether or not [/] and [g] are on a same arc of their pencil. This 
corresponds to <f>(t) having, or not, all its real roots of the same sign. 
The simplest way to translate it into algebraic identities is by using 
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Descartes' law of signs (precisely Lemma ITTT because <fi has all its roots 
real and non-zero in the considered cases). 

Proposition 7. Let [/], [g] be two distinct proper non-empty conies, 
generating a pencil in one of the orbits: I, la, II lb, III. Then {[/], [g]} 
is in the class N if and only if 

$30$12 > A $03$21 > 

3.4. Which is inside ? Suppose the pair of conies is in one of the 
classes: laN, UN, MaN, INN, MlaN, VN. Which conic lies inside the other 
? Otherwise stated, for any given class of pairs inside, we want to 
characterize the corresponding classes of couples. 

3.4.1. The antisymmetric invariant solves the problem for pair classes 
UN, llaN, IIIN, lllaN. The antisymmetric invariant is 

A = $30$? 2 - $03$21- 

First it is homogeneous of even degree, 6, in /, as well as in g. So its 
sign depends only on the algebraic conies, not on the quadratic forms 
defining them. 

Consider again Table [TJ Set 

(1) f = fo + ti9o, 9 = fo + h9o- 

From figures El and El for the cases la, II Ma, III, Ilia, the inner conic is 
the one nearer from /o, that is the one whose parameter (ti or t 2 ) has 
smaller absolute value. For case V, it is the one with whose parameter 
is smaller. Evaluate the antisymmetric invariant on (f,g). For II, Ha, 
III, Ilia, we get each time a positive rational number times 

(tMh -t 2 )f(t\-tl). 

This proves the following proposition. 

Proposition 8. Suppose ([/], [g]) is a couple of distinct proper non- 
empty conies, such that {[/], [g]} is in class UN, llaN, IIIN or lllaN. 

Then [f = 0] lies inside 10 of [g = 0] if and only if A(f,g) < 0. 

For VN, the evaluation of the antisymmetric invariant gives zero, and 
for la N it gives the expression 

(A - - ((ti + h) 2 - (tit 2 - 3) 2 ) 

whose sign is not clear. We need other methods to solve the question 
in these two cases. 



only at the neighborhood of the double intersection point for class UN. 
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3.4.2. The antisymmetric covariant solves the problem for class VN. 
Instead of considering the antisymmetric invariant, we can consider 
the following antisymmetric covariant 11 : 

B(f,g) = $12/ -$2i0. 

We consider its value on /, g generating a pencil in orbit V. It is 
enough to look at Levy's representative. Consider /, g as in ([TJ for 
Levy's representative of orbit V. Then 

ni 2 1 . 2 2 1 + 2\ h — ^2 2 

— y + tix ,xz — y + t 2 x ) = — - — x . 

Thus £>(/, (7) is a semi-definite quadratic form, negative when ti < t 2 
(that is [/ = 0] lies inside [0 = 0]) and positive in the opposite case. 

For the purpose of calculation, we use that one decides if a semi- 
definite quadratic form is negative or positive merely by considering 
the sign of the trace of its matrix. Define T = tr(i3(/, g)). 

Proposition 9. If f, g generate a pencil in orbit V, then the conic 
[f = 0] lies in inside the conic [g = 0] if and only ifT<0. 

3.4.3. Case laN. This case is more difficult than the previous ones. 
Suppose (/, g) is in class laN. After FigureEl (f>{t) has three roots of 

the same sign, two making ip > (conies of the pencil degenerating 
into isolated points) and one making ip < (conic degenerating into 
a double line). Denote them with ti,t 2 ,t 3 , such that \ti\ < \t 2 \ < \t 3 \. 
Denote also with v their common sign (note it is obtained as the sign 
of -$3o$o3)- The sign of $ 3 o0"(ti) is —v and the sign of $3o0"(t 3 ) is 
v (because $3o</>" is linear, with leading coefficient 6 $3 , positive, so 
it is increasing; its root lies between t\ and £3). 

The sign of $3o0"(^2) is unknown, denote it with e. 

After FigureEl [/ = 0] (resp. [g = 0]) is inside the other iff ip(ti) < 
(resp. ip(t 3 ) < 0). Thus we have the following table of signs: 





ti 


t 2 


h 


$300" 


—v 


£ 


V 




[/ = 0] inside 




+ 


+ 


[g = 0] inside 


+ 


+ 




$30 0> 


[/ = 0] inside 


V 


e 


V 


[g = 0] inside 


—v 


e 


—v 



One sees that a Sturm query of $ 3 o0'V f° r wn l gi ye 3 or 1 in one 
case, —3 or —1 in the other, allowing to obtain the relative position of 
the conies. Precisely, the Sturm queries corresponding to the situations 



This is a quadratic form, and actually the antisymmetric invariant of the pre- 
vious paragraph is its discriminant. 
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[/ = 0] inside vs. [g = 0] inside are given by the following table: 





v = + 


v = — 


; = + 


3 vs. — 1 


— 1 vs. 3 


e = — 


1 vs. — 3 


—3 vs. 1 


£ = 


2 vs. -2 


-2 vs. 2 



Let 

Q = — Remainder($3o0"0V; 0) 
= qi& + qit + q . 

Note that Q can be defined in a simpler way from the already intro- 
duced polynomial P = Remainder ($3o0V) 4>)i that is: Q = | Remainder (0"P, 0). 
Define E>i = srj(0, Q) for % between and 3. Then 



$30 






q-2 






$30 


$21 


$12 









Q2 


9i 





Finally 

P = -Res(0,Q). 
This last polynomial simplifies. Using Lemma El one gets: 

Res(P0",0) = -8$ 3O Res(0,Q) = 8$ 30 P - 
On the other hand, from Lemma El 

Res(P0", 0) = Res(P, 0) Res(0", 0). 

From Lemma Res(P, 0) = Res(0, P), and this is — A , which was 
proved to be equal to: 

Res(>,0) Disc($). 
Gathering this information, we get that: 

B = i$ 30 Res(^, 0) Res(0", 0) Disc($). 

o 

It is convenient to remark here that $30 divides Res(0", 0). We will 
define 

R . Res(0",0) 

8$ 30 

Thus 

B = ^ o Res(^,0)PDisc($). 

From lemmas El and it comes that Res(-0,0) = Res(0, ip) < and 
Res(0", 0) = - Res(0, 0") has the sign s. Last, Disc($) < 0. Thus B 
has the sign of £$30- 

The sign sequences si, S2, S3, S4 giving 3 or —3 are characterized by 
S1S3 > with S2S4 > 0. 
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The sign sequences giving 2 are + + +0 and 0, those giving 

—2 are H h0 and — I — 0. The first are characterized with respect 

to the second by Sis 2 > 0. 

If ev > 0, then [/ = 0] is inside iff $ 30 -Bi > with q 2 e§ 30 > 0. If 
ev < 0, then this characterizes [g = 0] inside. If e = 0, [/ = 0] is inside 

iff Z/$30<?2 > 0. 

Using that e is obtained as the sign of Res (</>", 0): 

Proposition 10. Suppose f, g are two non-degenerate quadratic forms 
generating a pencil in orbit la. Suppose that their zero locus are nested, 
that is (f,g) is in class Nl. The following are the necessary and suffi- 
cient conditions for [f = 0] lies inside [g = 0] : 

• when $03-R < 0, it is 

$30-Bi > and § 03 q 2 < 0; 

• when $03-R > 0, it is 

$30^1 < or $o 3 g 2 < 0; 

• when R = 0, it is 

$03^2 < 0. 

3.5. Recapitulation. Here we display the explicit definitions of the 
polynomials appearing in the description of the rigid isotopy classes. 
Note that all these formulas are short: the complicated polynomials 
express simply in terms of the less complicated ones. We also display 
the explicit description of the rigid isotopy classes. 



3.5.1. Formulas. We will denote the two forms as follows: 

f(x, y, z) = a 20 ox 2 + a 02 o2/ 2 + a 00 2^ 2 + a lw xy + a wl xz + a mi yz 
g(x, y, z) = b 2 oox 2 + b 020 y 2 + b 002 z 2 + b uo xy + b wl xz + b ou yz. 

We will denote similarly the coefficients of f,g,VL with a,ijk,bijk,u}ijk 
respectively. One has: 



a 200 — 



O020 



O002 



^020 


aon/2 


aon/2 


O002 


a-200 


aioi/2 


aioi/2 


O002 


^200 


ano/2 


ano/2 


OQ20 



a n — —2 
-2 
-2 



Qioi 



^110 



a 200 


ano/2 


aioi/2 


aon/2 


«020 


ano/2 


aon/2 


aioi/2 


^002 


aon/2 


aioi/2 


ano/2 
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Similarly the fe^'s are defined from the fr^'s, and 

^200 — ^020^002 + a 002^020 ~~ a 011^01l/2, 
^020 — &002&200 + ^200^002 — QlOl^lOl/2, 
^002 — ^020^200 + ^200^020 ~~ a 110^11o/2, 
^011 = ^200^011 + O011&200 — Oiio6lOl/2 — O101&110/2, 

^101 — ^020^101 + a ioi^o2o — a on^no/2 — ano^oii/2, 
^110 = ^002^110 + 0110^002 — Qoii^no/2 — ano^on/2. 
The (de-homogenized) characteristic form is 

<f>(t) = $ 30 i 3 + $2it 2 + $12* + $03 = Disc(*/ + g). 

Note that: 

$30 — 0200^200 + QlloOllO + OlOlOlOlj 

and 

$21 — ^200^200 + ^002^002 + ^020^020 + ^110^110 + ^101^101 + ^Oll^OH- 

There are similar formulas for $ 3 an d $i2) by exchanging a and b. 
The discriminant of the characteristic form can be obtained as 





3$30 


2$21 


$12 





1 





3$30 


2$21 


$12 


81 


$21 


2$12 


3$03 










$21 


2$12 


3$03 



and its Hessian determinant as 
(2) H = H 20 t 2 + H n tu + H 02 u 2 

3$ 30 $21 
$21 $12 



(3) 



4 



t 2 + 4 



3$30 
$21 



$12 
3$03 



tu + A 



$21 
$12 



$12 

3$03 



u 2 . 



The autopolar triangle covariant is: 

G — -[1 2 3}x 3 -[12 3}y 3 - [1 2 3> 3 + ([1 1 3] + 2[3 2 3])xy 2 
+ ([121] +2[2 2 3])a;2 2 + ([2 2 3] + 2 [I 3 3])yx 2 + ([1 2 2] + 2[1 1 3])yz 2 

+ ([3 2 3] + 2[1 2 2])zx 2 + ([1 3 3] + 2[1 2 l])zy 2 + ([1 2 3] + 4[1 2 3])xj/z. 

where [i j fc] denote the maximal minors of the matrix 



M 



^200 a 020 °002 a 011 °101 a 110 
^200 ^020 ^002 ^011 ^101 ^110 
^200 ^020 ^002 &011 &101 &110 



whose columns have been labeled 1, 2, 3, 1, 2, 3. 
Denote the coefficients of tp as follows: 

lf>(t) = ^20 t 2 + 2 tt n t + ^02, 

(beware the coefficient of t is 2^n) then 

^20 = ^200 + ^020 + ^002) 
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\I / 02 is the corresponding expression with b instead of a, and 

$11 = ^ (^200 + ^020 + ^002) • 

There is also /x = fj, 10 t + // i- Then 

A^lO = a 200 + a 020 + ^002 

and noi is defined by the corresponding formula with b instead of a. 
The polynomial P for the Sturm query of -0 for is 

P = Remainder ($30 <fi) = P2 t 2 + pi t + p 

with 

p 2 = 3$^ 02 - 2$ 2 l$ 3 0$ll - 2$ 12 $ 30 $20 + $21^20, 

Pl = 2$ 2 1$ 30 $02 - 4$i 2 $ 3 0$ll + $12$21$20 ~ 3$ 03 $30$20, 

p = $12$30*02 - 6$ 03 $30^11 + $03$21$20- 

The subresultant A x is 





$30 


$21 


$12 







P2 


Pi 




P2 


Pi 





The antisymmetric invariant is 

„4 = $ 30 $f 2 -$ 03 $3 1 . 

and the trace of the antisymmetric covariant is 

T = $12/^10 - $21/A)1- 

The polynomial Q for the Sturm query of $ 3O 0"-0 for is: 

Q = Remainder(P 0", 0) = P 0" - 6p 2 = <?2 t 2 + q 1 t + go- 
Its coefficients are 

q 2 = 3j9i$ 30 - 2p 2 $2i, 

qi = 3p $30 +Pi$2i - 3p 2 $i2, 

go = P $21 - 3p 2 $03- 

The subresultant B x is 





$30 


$21 


$12 







12 


11 




12 


11 


10 



The last quantity to consider is 

R = 27$| ) $ 3 + 2$^ - 6$ 30 $2i$i2- 
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Each of these expressions is homogeneous in the coefficients of / and 
as well in the coefficients of g. The following table gives their bi-degree. 





:(2,0) 


H i,j 


■■ (2 + i,2+j) 


A 


: (6,6) 


UJ a 


:(M) 


G 


: (3,3) 


T 


:(2,2) 


b a 


:(0,2) 


\tj. . 

^1,3 


: (ij) 




:(8,3) 






P2 


:(6,2) 




: (17,8) 


Disc($) 


:(6,6) 


A l 


: (13,6) 


R 


:(6,3) 



3.5.2. The decision procedure. 

First step: decide the orbit of pencils. Here are the descriptions of the 
sets of couples of distinct proper conies generating a pencil in a given 
orbit. 



I 

la 
lb 
II 
Ma 
III 
Ilia 
IV 
V 



Disc($) <0Ap 2 <0A $ 30 Ai > 

Disc($) < A [p 2 > V $30^! < V [Ax = A p 2 = 0]] 
Disc($) > 

Disc($) = 0AiJ^0AG'^0Aj9 2 <0A $30^ > 
Disc($) = 0AiJ^0AG'^0A[p 2 = 0V $30^1 < 0] 
Disc($) = 0AH^0AG = 0Ap 2 <0 
Disc($) = 0AiJ^0AG' = 0Ap 2 >0 
H = AG ^ 
H = 0AG = 0. 



Second step: decide the class of pairs. There is only one rigid isotopy 
class for pairs (class N) corresponding to each of the orbits of pencils 
lb, Ilia, IV, V. 

There are two classes (N or S) corresponding to I la, II, Ma, III. The 
criterion for being in the class N is: 

$ 30 $12 > A $03$21 > 0. 

Third step (nested cases): decide which of the conies is inside the other. 
The classes of pairs splitting into two classes of couples are: laN, MaN, 
MIN, MlaN, VN. 

The criteria for [/ = 0] lies inside [g = 0] are the following: 

• UN, MaN, MIN, MlaN: A < 0. 

• VN: T < 0. 

• laN: 





sign of $03-R 




+ 





criterion 


$30^1 > 


$ 03 B 1 < 




for [/ = 0] 


A 


V 


$03<?2 < 


inside 


% 3 q 2 < 


$03<?2 < 
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4. Examples and applications 

We consider examples and applications for our work. In all of them, 
we specialize the above general formulas to pairs of quadratic forms 
depending on parameters. We obtain a complicated description of the 
partition of the parameters space into the subsets corresponding to the 
isotopy classes. We then use Christopher Brown's program SLFQ of 
simplification of large quantifier-free formulas [I] to get simpler descrip- 
tions. 

4.1. Two ellipsoids. We consider two ellipsoids given by the equa- 
tions (example 2 in [2*T]): 

x 2 + y 2 + z 2 - 25 = 0, 

(x — 6) 2 v 2 z 2 

- - + — + 1 = 0. 

9 4 16 

We consider then as equations in x, y of two affine conies depending on 
a parameter z. This corresponds to using a sweeping plane to explore 
the two ellipsoids. We homogenize the equations in x, y with t, thus 
considering: 

/= x 2 +y 2 + t 2 (z 2 -25), 

The quantity Disc($) is here h = A9z 4 + 2516z 2 - 229376. One checks 
easily that h has two single real roots z , —z with < z < 4. When 
the two conies are proper and non-empty, that is when —4 < z < 4, 
one finds, using our formulas, that the following classes can occur: 

• laS when h > 0, that is — 4 < z < —z or z < z < 4. 

• MaS when h = 0, that is z = ±z . 

• IbN when h < 0, that is — Zq < z < z . 

The ellipsoids go each through the other. 

4.2. A paraboloid and an ellipsoid. Our equations, inequations, 
inequalities can tell the relative position of any two conies, not only 
ellipses, because of the choice of working in the projective plane. 

Thus we can apply also the method of the previous example to any 
kind of quadric. In the following example, one considers a paraboloid 
and an ellipsoid: 

Ax 2 - Axy + 2y 2 - Axz + lAx - Qy + 2z 2 - lOz + 12 = 0, 
3a; 2 - Axy + 2y 2 - Axz + lQx + 2yz - 12y + 2^ 2 - lQz + 39 = 

As before, we consider Z clS 8b parameter and homogenize the equations 
in x, y with t, thus considering: 

/ = Ax 2 - Axy + 2y 2 + t(-Axz + Ux - Qy) + t 2 (2z 2 - l(k + 12), 
g = 3x 2 - Axy + 2y 2 + t(-Axz + 16x + 2yz - I2y) + t 2 (2^ 2 - 16z + 39) 
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We specialize our equations, inequations and inequalities and run SLFQ. 
Let z = —1/4 and Zi < z 2 be the two roots of z 2 — 12z + 34. One 
finds that z < Zi, and [/ = 0] is proper non-empty when z > z , 
[g = 0] is proper non-empty when Z\ < z < z 2 . When both are proper 
and non-empty, one finds that the isotopy class is always laN. Thus the 
ellipsoid is inside the paraboloid. 



4.3. Uhlig's canonical forms. In [H]], Uhlig presented representa- 
tives for the orbits under GL(n,~R) of couples of quadratic forms gen- 
erating a non-degenerate pencil. 

For conies (n = 3), it follows from Uhlig's presentation that any 
couple of conies can be transformed, by means of PSX(3,R), into one 
with associated couple of matrices among: 



'Ai 



A, 



-1 



Ai 
Ai 1 

b a 
a —b 



A, 



A 



21, 



31; 



-1 



'Al 



Ai 
Ai 1 

b a 
a —b 



-A, 



12, 



22 ; 



-A 



32 i 



l" 




A" 




1 


1 


A 1 




1 




A 1 





To which configuration corresponds each of these normal forms ? 

We find simple description for the subsets of each parameters space 
corresponding to the isotopy classes. 

As an illustration, we show the result for L^i- 

• g is degenerate when Ai = or A 2 = 0. 

• the conies are in class VN when Ai = X 2 ^ 0. In this case, 
[g = 0] lies inside [/ = 0]. 

• in the other cases, the conies are in class UN, IIS, I la N or MaS as 
shown in Figure 



5. Final remarks 

For clarity of the exposition, we have not considered the case when 
one conic, or both conies, are degenerated; but it is easy to list the 
corresponding isotopy classes and describe them with equations, in- 
equations and inequalities. 
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Figure 7. isotopy classes for representatives U^x- 



Remark that the polynomials involved in the description of the classes, 
specially invariants and covariants, have often very compact expres- 
sions in function of the smaller ones. Thus they can be evaluated with 
substantial saving of arithmetic operations, as was pointed out in |Hj. 

The following, more ambitious, step is the classification of couples 
of quadrics drawn in MP 3 . Hopefully some of the methods developed 
in the present paper will be useful in this task, on which we wish to 
return in another paper. 

It follows from our study that the rigid isotopy classes for couples of 
conies are characterized nearly totally by the behavior of the signature 
function on the pencil generated by the quadratic forms. For the non- 
generic classes, this provides a precise answer to a question formulated 
in [20] • We plan also to develop this point in a forthcoming paper with 
B. Mourrain. 

Finally, the reader will find some implementations and complements 
on the subject on the author's web page devoted to the paper: 
http : / /emmanuel . j ean . briand .free . f r/publications/twoconics 
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